Papers with cross-lingual systems
UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages (2024.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models are weak in addressing cross-lingual transfer tasks. |
| Approach: | They propose a method for initializing embeddings and choosing the right vocabulary size for cross-lingual systems. |
| Outcome: | The proposed method improves the F1-Score in several languages . |
LAReQA: Language-Agnostic Answer Retrieval from a Multilingual Pool (2020.emnlp-main)
Copied to clipboard
| Challenge: | LAReQA tests for “strong” cross-lingual alignment, requiring semantically related cross-language pairs to be closer in representation space than unrelated same-language pair. |
| Approach: | They propose a new benchmark for language-agnostic answer retrieval from a multilingual candidate pool that tests for "strong" cross-lingual alignment . they augment training data via machine translation and find that model performance is improved by augmenting training data through machine translation . |
| Outcome: | The proposed task is based on multilingual BERT (mBERT) and XLM-R. |